ABSTRACT
This study aimed to estimate validity evidence based on the internal structure and accuracy of the adapted version of the Learning Strategies Assessment Scale for High School (EAVAP-EM), using Confirmatory Factor Analysis (CFA). Participants were 701 first- to third-year high school students (M = 16.1; SD = 1.0), from public and private institutions in the states of Paraná and São Paulo. The CFA indicated the presence of the three factors of the EAVAP-EM, with adequate internal consistency. The instrument also showed good fit indices. There were positive and significant correlations between the factors, with magnitude ranging from medium to large. Moreover, students reported making more use of metacognitive strategies. The results evinced significant advances regarding measures with good psychometric parameters to assess learning strategies, considering their relevance to the psychoeducational context (AU).
Objetivou-se no presente estudo estimar indicadores de validade com base na estrutura interna e precisão da versão adaptada da Escala de Avaliação das Estratégias de Aprendizagem para o Ensino Médio (EAVAP-EM), por meio de uma análise fatorial confirmatória (AFC). Participaram 701 alunos do primeiro ao terceiro ano do Ensino Médio (M = 16,1; DP = 1,0), provenientes de instituições públicas e particulares dos estados do Paraná e de São Paulo. A AFC indicou a presença dos três fatores da EAVAP-EM, com consistência interna considerada adequada, sendo que o instrumento apresentou bons índices de ajuste. Houve correlações positivas e significativas entre os fatores, com magnitude variando de média a grande. Ainda, os estudantes reportaram fazer mais uso de estratégias metacognitivas. Os resultados evidenciam importantes avanços no que concerne a medidas com bons indicadores psicométricos para avaliação das estratégias de aprendizagem, considerando sua relevância ao contexto psicoeducacional (AU).
El objetivo del presente estudio fue estimar evidencias de validez a partir de la estructura interna y la precisión de la versión adaptada de la Escala de Evaluación de Estrategias de Aprendizaje para la Escuela Preparatoria (EAVAP-EM), mediante un Análisis Factorial Confirmatorio (AFC). Participaron 701 estudiantes de primero a tercer año de secundaria (M = 16.1; DS = 1.0), de instituciones públicas y privadas de las provincias de Paraná y São Paulo. El AFC indicó la presencia de los tres factores del EAVAP-EM, con consistencia interna considerada adecuada. El instrumento mostró índices de ajuste adecuados. Hubo correlaciones positivas y significativas entre los factores, cuya magnitud varió de moderada a alta. Además, los estudiantes informaron que hacen un mayor uso de las estrategias metacognitivas. Los resultados evidencian avances importantes en cuanto a medidas con buenos indicadores psicométricos para evaluar estrategias de aprendizaje, considerando su relevancia para el contexto psicoeducativo (AU).
Subject(s)
Humans , Male , Female , Adolescent , Adult , Psychometrics , Metacognition , Learning , Students/psychology , Reproducibility of Results , Education, Primary and SecondaryABSTRACT
This study aimed to estimate validity evidence based on the internal structure and accuracy of the adapted version of the Learning Strategies Assessment Scale for High School (EAVAP-EM), using Confirmatory Factor Analysis (CFA). Participants were 701 first- to third-year high school students (M = 16.1; SD = 1.0), from public and private institutions in the states of Paraná and São Paulo. The CFA indicated the presence of the three factors of the EAVAP-EM, with adequate internal consistency. The instrument also showed good fit indices. There were positive and significant correlations between the factors, with magnitude ranging from medium to large. Moreover, students reported making more use of metacognitive strategies. The results evinced significant advances regarding measures with good psychometric parameters to assess learning strategies, considering their relevance to the psychoeducational context (AU).
Objetivou-se no presente estudo estimar indicadores de validade com base na estrutura interna e precisão da versão adaptada da Escala de Avaliação das Estratégias de Aprendizagem para o Ensino Médio (EAVAP-EM), por meio de uma análise fatorial confirmatória (AFC). Participaram 701 alunos do primeiro ao terceiro ano do Ensino Médio (M = 16,1; DP = 1,0), provenientes de instituições públicas e particulares dos estados do Paraná e de São Paulo. A AFC indicou a presença dos três fatores da EAVAP-EM, com consistência interna considerada adequada, sendo que o instrumento apresentou bons índices de ajuste. Houve correlações positivas e significativas entre os fatores, com magnitude variando de média a grande. Ainda, os estudantes reportaram fazer mais uso de estratégias metacognitivas. Os resultados evidenciam importantes avanços no que concerne a medidas com bons indicadores psicométricos para avaliação das estratégias de aprendizagem, considerando sua relevância ao contexto psicoeducacional (AU).
El objetivo del presente estudio fue estimar evidencias de validez a partir de la estructura interna y la precisión de la versión adaptada de la Escala de Evaluación de Estrategias de Aprendizaje para la Escuela Preparatoria (EAVAP-EM), mediante un Análisis Factorial Confirmatorio (AFC). Participaron 701 estudiantes de primero a tercer año de secundaria (M = 16.1; DS = 1.0), de instituciones públicas y privadas de las provincias de Paraná y São Paulo. El AFC indicó la presencia de los tres factores del EAVAP-EM, con consistencia interna considerada adecuada. El instrumento mostró índices de ajuste adecuados. Hubo correlaciones positivas y significativas entre los factores, cuya magnitud varió de moderada a alta. Además, los estudiantes informaron que hacen un mayor uso de las estrategias metacognitivas. Los resultados evidencian avances importantes en cuanto a medidas con buenos indicadores psicométricos para evaluar estrategias de aprendizaje, considerando su relevancia para el contexto psicoeducativo (AU).
Subject(s)
Humans , Male , Female , Adolescent , Adult , Psychometrics , Metacognition , Learning , Students/psychology , Reproducibility of Results , Education, Primary and SecondaryABSTRACT
This study aimed to estimate validity evidence based on the internal structure and accuracy of the adapted version of the Learning Strategies Assessment Scale for High School (EAVAP-EM), using Confirmatory Factor Analysis (CFA). Participants were 701 first- to third-year high school students (M = 16.1; SD = 1.0), from public and private institutions in the states of Paraná and São Paulo. The CFA indicated the presence of the three factors of the EAVAP-EM, with adequate internal consistency. The instrument also showed good fit indices. There were positive and significant correlations between the factors, with magnitude ranging from medium to large. Moreover, students reported making more use of metacognitive strategies. The results evinced significant advances regarding measures with good psychometric parameters to assess learning strategies, considering their relevance to the psychoeducational context (AU).
Objetivou-se no presente estudo estimar indicadores de validade com base na estrutura interna e precisão da versão adaptada da Escala de Avaliação das Estratégias de Aprendizagem para o Ensino Médio (EAVAP-EM), por meio de uma análise fatorial confirmatória (AFC). Participaram 701 alunos do primeiro ao terceiro ano do Ensino Médio (M = 16,1; DP = 1,0), provenientes de instituições públicas e particulares dos estados do Paraná e de São Paulo. A AFC indicou a presença dos três fatores da EAVAP-EM, com consistência interna considerada adequada, sendo que o instrumento apresentou bons índices de ajuste. Houve correlações positivas e significativas entre os fatores, com magnitude variando de média a grande. Ainda, os estudantes reportaram fazer mais uso de estratégias metacognitivas. Os resultados evidenciam importantes avanços no que concerne a medidas com bons indicadores psicométricos para avaliação das estratégias de aprendizagem, considerando sua relevância ao contexto psicoeducacional (AU).
El objetivo del presente estudio fue estimar evidencias de validez a partir de la estructura interna y la precisión de la versión adaptada de la Escala de Evaluación de Estrategias de Aprendizaje para la Escuela Preparatoria (EAVAP-EM), mediante un Análisis Factorial Confirmatorio (AFC). Participaron 701 estudiantes de primero a tercer año de secundaria (M = 16.1; DS = 1.0), de instituciones públicas y privadas de las provincias de Paraná y São Paulo. El AFC indicó la presencia de los tres factores del EAVAP-EM, con consistencia interna considerada adecuada. El instrumento mostró índices de ajuste adecuados. Hubo correlaciones positivas y significativas entre los factores, cuya magnitud varió de moderada a alta. Además, los estudiantes informaron que hacen un mayor uso de las estrategias metacognitivas. Los resultados evidencian avances importantes en cuanto a medidas con buenos indicadores psicométricos para evaluar estrategias de aprendizaje, considerando su relevancia para el contexto psicoeducativo (AU).
Subject(s)
Humans , Male , Female , Adolescent , Adult , Psychometrics , Metacognition , Learning , Students/psychology , Reproducibility of Results , Education, Primary and SecondaryABSTRACT
BACKGROUND: Digital technologies have changed how we manage our health, and eHealth literacy is needed to engage with health technologies. Any eHealth strategy would be ineffective if users' eHealth literacy needs are not addressed. A robust measure of eHealth literacy is essential for understanding these needs. On the basis of the eHealth Literacy Framework, which identified 7 dimensions of eHealth literacy, the eHealth Literacy Questionnaire (eHLQ) was developed. The tool has demonstrated robust psychometric properties in the Danish setting, but validity testing should be an ongoing and accumulative process. OBJECTIVE: This study aims to evaluate validity evidence based on test content, response process, and internal structure of the eHLQ in the Australian community health setting. METHODS: A mixed methods approach was used with cognitive interviewing conducted to examine evidence on test content and response process, whereas a cross-sectional survey was undertaken for evidence on internal structure. Data were collected at 3 diverse community health sites in Victoria, Australia. Psychometric testing included both the classical test theory and item response theory approaches. Methods included Bayesian structural equation modeling for confirmatory factor analysis, internal consistency and test-retest for reliability, and the Bayesian multiple-indicators, multiple-causes model for testing of differential item functioning. RESULTS: Cognitive interviewing identified only 1 confusing term, which was clarified. All items were easy to read and understood as intended. A total of 525 questionnaires were included for psychometric analysis. All scales were homogenous with composite scale reliability ranging from 0.73 to 0.90. The intraclass correlation coefficient for test-retest reliability for the 7 scales ranged from 0.72 to 0.95. A 7-factor Bayesian structural equation modeling using small variance priors for cross-loadings and residual covariances was fitted to the data, and the model of interest produced a satisfactory fit (posterior productive P=.49, 95% CI for the difference between observed and replicated chi-square values -101.40 to 108.83, prior-posterior productive P=.92). All items loaded on the relevant factor, with loadings ranging from 0.36 to 0.94. No significant cross-loading was found. There was no evidence of differential item functioning for administration format, site area, and health setting. However, discriminant validity was not well established for scales 1, 3, 5, 6, and 7. Item response theory analysis found that all items provided precise information at different trait levels, except for 1 item. All items demonstrated different sensitivity to different trait levels and represented a range of difficulty levels. CONCLUSIONS: The evidence suggests that the eHLQ is a tool with robust psychometric properties and further investigation of discriminant validity is recommended. It is ready to be used to identify eHealth literacy strengths and challenges and assist the development of digital health interventions to ensure that people with limited digital access and skills are not left behind.
Subject(s)
Health Literacy , Telemedicine , Australia , Bayes Theorem , Cross-Sectional Studies , Health Literacy/methods , Humans , Psychometrics/methods , Public Health , Reproducibility of Results , Surveys and Questionnaires , Telemedicine/methodsABSTRACT
The Burnout Assessment Tool (BAT) has been gaining increased attention as a sound and innovative instrument in its conceptualization of burnout. BAT has been adapted for several countries, revealing promising validity evidence. This paper aims to present the psychometric properties of the Brazilian and Portuguese versions of the BAT in both the 23-item and 12-item versions. BAT's validity evidence based on the internal structure (dimensionality, reliability, and measurement invariance) and validity evidence based on the relations to other variables are the focus of research. A cross-sectional study was conducted with two non-probabilistic convenience samples from two countries (N = 3103) one from Brazil (nBrazil = 2217) and one from Portugal (nPortugal = 886). BAT's original structure was confirmed, and it achieved measurement invariance across countries. Using both classic test theory and item response theory as frameworks, the BAT presented good validity evidence based on the internal structure. Furthermore, the BAT showed good convergent evidence (i.e., work engagement, co-worker support, role clarity, work overload, and negative change). In conclusion, the psychometric properties of the BAT make this freely available instrument a promising way to measure and compare burnout levels of Portuguese and Brazilian workers.